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Abstract 



We aim to provide a Feynman-Kac type representation for Hamilton- Jacobi-Bcllman 
equation, in terms of Forward Backward Stochastic Differential Equation (FBSDE) with 
a simulatable forward process. For this purpose, we introduce a class of BSDE where 
the jumps component of the solution is subject to a partial nonpositive constraint. 
Existence and approximation of a unique minimal solution is proved by a penalization 
method under mild assumptions. We then show how minimal solution to this BSDE 
class provides a new probabilistic representation for nonlinear integro-partial differential 
equations (IPDEs) of Hamilton- Jacobi-Bcllman (HJB) type, when considering a regime 
switching forward SDE in a Markovian framework. Moreover, we state a dual formula of 
this BSDE minimal solution involving equivalent change of probability measures. This 
gives in particular an original representation for value functions of stochastic control 
problems including controlled diffusion coefficient. 

Key words: BSDE with jumps, constrained BSDE, regime-switching jump-diffusion, 
Hamilton-Jacobi-Bellman equation, nonlinear Integral PDE, viscosity solutions, inf-convolution, 
semiconcave approximation. 



"The authors would like to thank Pierre Cardaliaguet for useful discussions. 

''The research of the author benefited from the support of the French ANR research grant LIQUIRISK. 



MSC Classification: 60H10, 60H30, 35K55, 93E20. 



1 



1 Introduction 



The classical Feynman-Kac theorem states that the solution to the linear parabolic partial 
differential equation (PDE) of second order: 



— + b(x).D x v + -tr(aa T {x)D 2 x v) + f(x) 



(t,x) G [0,T) x 



= o, 

v(T, x) = g(x), x G 
may be probabilistically represented under some general conditions as (see e.g. |10j): 



v(t, x) 



E 



t.X\ 



(1.1) 



where X t,x is the solution to the stochastic differential equation (SDE) driven by a d- 
dimensional Brownian motion W on a filtered probability space (£l,J~, (J-t)t,P): 



dX„ 



b(X s )ds + a(X s )dW s , 



starting from x G M. d at t G [0, T]. By considering the process Yt = v(t,Xt), and from Ito's 
formula (when v is smooth) or in general from martingale representation theorem w.r.t. the 
Brownian motion W, the Feynman-Kac formula (|l-lj) is formulated equivalently in terms 
of (linear) Backward Stochastic Equation: 

Y t = g(X T )+ [ T f(X s )ds- [ T Z s dW a , t<T, 
Jt Jt 

with Z an adapted process, which is identified to: Zt = a J (Xt)D x v(t, Xt) when v is smooth. 
Let us now consider the Hamilton-Jacobi-Bellman (HJB) equation in the form: 



dv 
dt 



+ sup [b(x, a).D x v + -tr(o"<7 T (x, a)D x v ) + f(x, a)] = 0, on [0, T) 



X2) 



v(T, x) 



9{x) 



x G 



where A is a subset of M 9 . It is well-known (see e.g. [20]) that such nonlinear PDE is the 
dynamic programming equation associated to the stochastic control problem with value 
function defined by: 



v(t, x) 



supE 

a <-Jt 



f(X t f' a ,a s )ds + g(X, 



T 



[1.3) 



where X t,x,a is the solution to the controlled diffusion: 

dXf = b(X«,a s )ds + a(X°,a s )dW s , 

starting from x at t, and given a predictable control process a valued in A. 

Our main goal is to provide a probabilistic representation for the nonlinear HJB equation 
using Backward Stochastic Differential Equation (BSDEs), namely the so-called nonlinear 
Feynman-Kac formula, which involves a simulatable forward process. One can then hope 
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to use such representation for deriving a probabilistic numerical scheme for the solution to 
HJB equation, whence the stochastic control problem. Such issues have attracted a lot of 
interest and generated an important literature over the recent years. Actually, there is a 
crucial distinction between the case where the diffusion coefficient is controlled or not. 

Consider first the case where cr(x) does not depend on a £ A, and assume that aa J (x) 
is of full rank. Denoting by 6(x,a) = a T (x)(aa T (x))~ 1 b(x, a) a solution to a(x)9(x,a) = 
b(x,a), we notice that the HJB equation reduces into a semi-linear PDE: 

-^ + -tr(aa^x)D 2 x v)+F(x,aW x v) = 0, (1.4) 

where F(x, z) = sup aG ^[/(x, a) + 9(x, a).z] is the 6>-Fenchel-Legendre transform of /. In this 
case, we know from the seminal works by Pardoux and Peng [15], [16], that the (viscosity) 
solution v to the semi-linear PDE (|1.4p is connected to the BSDE: 

Y t = g(X°) + £ F(X° s ,Z s )ds- £ Z s dW s , t<T, (1.5) 

through the relation Yt = v(t,X^), with a forward diffusion process 

dX° s = <r(X° s )dW s . 

This probabilistic representation leads to a probabilistic numerical scheme for the resolution 
to (ll.4p by discretization and simulation of the BSDE (II. 5p . see [5]. Alternatively, when the 
function F(x, z) is of polynomial type on z, the semi-linear PDE (ll.4p can be numerically 
solved by a forward Monte-Carlo scheme relying on marked branching diffusion, as recently 
pointed out in [11] , Moreover, as showed in [8], the solution to the BSDE (jl.5p admits a 
dual representation in terms of equivalent change of probability measures as: 

r-T 



Y t = ess sup E 



J f(X°,a s )ds + g(X°)\F t ], (1.6) 



where for a control a, P Q is the equivalent probability measure to P under which 

dX° s = b(X° s ,a s )ds + a{X° s )dWf, 

with W a a P Q -Brownian motion by Girsanov's theorem. In other words, the process X° has 
the same dynamics under P a than the controlled process X a under P, and the representation 
(]1.6p can be viewed as a weak formulation (see [7]) of the stochastic control problem (II. 3D 
in the case of uncontrolled diffusion coefficient. 

The general case with controlled diffusion coefficient a(x,a) associated to fully nonlinear 
PDE is challenging and led to recent theoretical advances. Consider the motivating example 
from uncertain volatility model in finance formulated here in dimension 1 for simplicity of 
notations: 

dXf = a s dW s , 

where the control process a is valued in A = [a, a] with < a < a < oo, and define the 
value function of the stochastic control problem: 

v(t,x) := supE[ 5 (A^f' a )], (t, x) £ [0, T] x R. 
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The associated HJB equation takes the form: 

- — -G(D 2 x v) = 0, (t, x) G [0, T) x R, v(T,x) = g(x), xGR, (1.7) 

where G(M) = ±sup aeA [a 2 M] = a 2 M + - q?M~ . The unique (viscosity) solution to (fT7T|) 
is represented in terms of the so-called G-Brownian motion B, and G-expectation Eg, 
concepts introduced in [18]: 



v{t,x) = E G [g(x + B T - t )]. 

Moreover, G-expectation is closely related to second order BSDE studied in [23], namely 
the process Yt = v(t, Bt) satisfies a 2BSDE, which is formulated under a nondominated 
family of singular probability measures given by the law of X a under P. This gives a nice 
theory and representation for nonlinear PDE, but it does not cover general HJB equation 
(i.e. control both on drift and diffusion), and on the other hand, it is not clear how to 
simulate G-Brownian motion. 

We provide here an alternative BSDE representation including general HJB equation, 
formulated under a single probability measure (thus avoiding nondominated singular mea- 
sures) under which the forward process can be easily simulated. The idea, used in [12] 
for quasi variational inequalities arising in impulse control problems, is the following. We 
introduce a Poisson random measure fi A (dt, da) on R + x A with finite intensity measure 
\ A {da)dt associated to the marked point process (ri,Ci)ij independent of W, and consider 
the pure jump process (It)t equal to the mark Q valued in A between two jump times 
and Tj.fi. We next consider the forward regime switching diffusion process 

dX s = b(X s ,I s )ds + a(X s ,I s )dW s , 

and observe that the (uncontrolled) pair process (X, I) is Markov. Let us then consider the 
BSDE with jumps w.r.t the Brownian-Poisson filtration F = W w,ix a; 

Y t = g(X T )+ [ T f(X s ,I s )ds- C Z s dW s - [ T [ U s (a)fl A (ds,da), (1.8) 

Jt Jt Jt J A 

where \x A is the compensated measure of \x A . This linear BSDE is the Feynman-Kac formula 
for the linear integro-partial differential equation (IPDE): 

— + b(x, a).D x v + -tr(aa'(x, a)D 2 x v) (1.9) 

+ (v(t,x,a') -v(t,x,a))X A (da') + f(x,a) = 0, (t, x, a) G [0, T) x R d x A, 
J A 

v(T,x,a) = g(x), (x,a)eR d xA, (1.10) 

through the relation: Yt = v(t, Xt, It)- Now, in order to pass from the above linear IPDE 
with the additional auxiliary variable a G A to the nonlinear HJB PDE (|1.2p . we constrain 
the jump component to the BSDE (jl.8p to be nonpositive, i.e. 



U t (a) < 0, V(t,a). (1.11) 
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Then, since Ut(a) represents the jump of Yt = v(t, Xt,It) induced by a jump of the random 
measure fi, i.e of /, and assuming that v is continuous, the constraint (jl.lip means that 
Ut(a) = v(t,Xt,a) — v(t, Xt, I t -) < for all (t, a). This formally implies that v(t,x) should 
not depend on a £ A. The rigorous proof of this crucial property is actually quite technical 
and relies on fine viscosity solutions arguments as we don't know a priori any continuity 
results on v. Once we get the non dependence of v in a, the equation (|1.9|) becomes a PDE 
on [0, T) x M d with a parameter a 6 A. By taking the supremum over a 6 A in (jl.9p . we 
formally obtain the nonlinear HJB equation (|1.2[) . 

Inspired by the above discussion, we now introduce the following general class of BSDE 
with partially nonpositive jumps, which is a non Markovian extension of (jl.8p - (jl,lip : 

Y t = £ + f* ' F{ S ,Lo,Y s ,Z s ,U s )ds + K T -K t (1.12) 

-f Z s dW s - [ [ U s (e)jl(ds,de), < t < T, a.s. 

Jt Jt J E 



with 



U t (e) < 0, dF <g> dt ® X(de) a.e. on x [0, T] x A. (1.13) 



Here /i is a Poisson random measure on K + x £7 with intensity measure X(de)dt, A a subset 
of E, £ an J-y measurable random variable, and F a generator function. The solution to 
this BSDE is a quadruple (Y, Z,U, K) where, besides the usual component (Y,Z,U), the 
fourth component K is a predictable nondecreasing process, which makes the ^-constraint 
(I1.13P feasible. We thus look at the minimal solution (Y, Z, U, K) in the sense that for any 
other solution (Y,Z,U,K) to (fTT2]) - (fn5|) . we must have Y <Y. 

We use a penalization method for constructing an approximating sequence (Y n , Z n , U n , K n ) 7 
of BSDEs with jumps, and prove that it converges to the minimal solution that we are 
looking for. The proof relies on comparison results, uniform estimates and monotonic con- 
vergence theorem for BSDEs with jumps. Notice that compared to [12], we do not assume 
that the intensity measure A of /i is finite on the whole set E, but only on the subset A on 
which the jump constraint is imposed. We then put us in a suitable Markovian framework 
by considering a forward regime switching jump-diffusion process (X,I), and our main re- 
sult is to relate the minimal solution to the BSDE with A-nonpositive jumps to a fully 
nonlinear IPDE of HJB type: 



dv 

-wr + sup 

ot a &A l 



b(x, a).D x v(t, x) + -tr(o"<r T (x, a)D 2 x v(t, x)) 



+ / [v(t, x + /3(x, a, e)) — w(t, x) — ft(x, a, e).D x v(t, x)] X(de 
Je\a 



+ f(x,a,v,a T (x,a)D x v) = 0, on [0, T) x 



This equation clearly extends HJB equation (jl.2p by incorporating integral terms, and with 
a function / depending on v, D x v (actually, we may also allow / to depend on integral 
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terms). By the Markov property of the forward regime switching jump-diffusion process, 
we easily see that the minimal solution to the the BSDE with A-nonpositive jumps is a 
deterministic function v of (t, x, a). The main task is to derive the key property that v does 
not actually depend on a, as a consequence of the A-nonpositive constrained jumps, and the 
proof relies on sharp arguments from viscosity solutions, inf-convolution and semiconcave 
approximation. 

In the case where the generator function F or / does not depend on y, z, u, which 
corresponds to the stochastic control framework, we provide a dual representation of the 
minimal solution to the BSDE by means of a family of equivalent change of probability 
measures in the spirit of (jl.6p . This gives in particular an original representation for 
value functions of stochastic control problems, and unifies the weak formulation for both 
uncontrolled and controlled diffusion coefficient. 

The rest of the paper is organized as follows. In Section 2, we give a detailed formula- 
tion of BSDE with partially nonpositive jumps. We develop in Section 3 the penalization 
approach for studying the existence and the approximation of a unique minimal solution to 
our BSDE class. In Section 4, we give a dual representation of the minimal BSDE solution 
in the stochastic control case. We show in Section 5 how the minimal BSDE solution is 
related by means of viscosity solutions to the nonlinear IPDE of HJB type. Finally, we 
conclude in Section 6 by indicating extensions to our paper, and suggesting some possible 
probabilistic numerical schemes for the resolution of HJB equations. 



2 BSDE with partially nonpositive jumps 

Let (f2, F, P) be a complete probability space on which are defined a d-dimensional Brownian 
motion W = (Wt)t>o, and an independent integer valued Poisson random measure fj, on 
R+ x E, where E is a Borelian subset of R 9 , endowed with its Borel cr-field B{E). We 
assume that the random measure \x has the intensity measure \{de)dt for some u-finite 
measure A on (E, 13(E)) satisfying 

(l A |e| 2 ) A(cfe) < oo . 

E 

We set p,(dt, de) = fj,(dt, de) — X(de)dt, the compensated martingale measure associated to 
and denote by F = (Ft)t>o the completion of the natural filtration generated by W and 

A*- 

We fix a finite time duration T < oo and we denote by V the cr-algebra of F-predictable 
subsets of Q x [0, T]. Let us introduce some additional notations. We denote by 

• S 2 the set of real-valued cadlag adapted processes Y = (lt)o<t<r such that ||Y| 



E 



SUp <t<Tl^i| 



s 2 

1 

2 

< OO. 



L p (0, T), p > 1, the set of real-valued adapted processes (<f>t)o<t<T such that E J Q T \4>t\ p dt 
< oo. 
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• L P (W), p > 1, the set of Revalued "P-measurable processes Z = (Z t )o<t<T such that 



I^ILpcw) -IE 



i 



< OO. 



Jo \Zt\ p dt_ 

L p (/i), p > 1, the set of P ® i3(£)-measurable maps [/:Ox[0,T]x£^l such that 



i 

< oo. 



• L 2 (A) is the set of B(£ , )-measurable maps u : E — > R such that \u\ 2 := ( f p |it(e)| 2 A((ie) 
< oo. 

• K 2 the closed subset of S 2 consisting of nondecreasing processes K = (-fQ)o<t<T with 
K = 0. 

We are then given three objects: 

1. A terminal condition £, which is an J-r-measurable random variable. 

2. A generator function F : O x [0, T] x R x R ' x L 2 (A) ->■ R, which is a 7> S(R) ® 
£?(R d ) g) 5(L 2 (A))-measurable map. 

3. A Borelian subset A of such that \(A) < oo. 

We shall impose the following assumption on these objects: 
(HO) 

(i) The random variable £ and the generator function F satisfy the square integrability 
condition: 



T 



E[|£| 2 ]+E / |F(i,0,0,0)| 2 cft 



< oo 



(ii) The generator function F satisfies the uniform Lipschitz condition: there exists a 
constant Cf such that 

\F(t,y,z,u)-F(t,y',z',u')\ < C F (\y - y'\ + \z - z'\ + \u - u\ 2(x) ) , 

for all t G [0,T], G R, G R d and u, u' G L 2 (A). 

(iii) The generator function F satisfies the monotonicity condition: 

F(t,y,z,u) - F(t,y,z,u') < / j(t, e, y, z, u, u'){u{e) - u'(e))X(de) , 



for all t G [0, T], z G R d , y G R and u, u' G L 2 (A), where 7 : [0,T]x!]x£xlxR' i x 
L 2 (A) xL 2 (A) ^Ris aP®^( J B)®^(R)®B(R d )®B(L 2 (A))®^(L 2 (A))-measurable 
map satisfying: Ci(l A |e|) < "y(t,e,y, z,u,u') < C<2(1 A |e|), for all e £ E, with two 
constants — 1 < C\ < < C2. 
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Let us now introduce our class of Backward Stochastic Differential Equations (BSDE) 
with partially nonpositive jumps written in the form: 

Y t = C + J t F(s,Y s ,Z s ,U s )ds + K T -K t (2.1) 

Z s dW s - [ [ U s (e)fi(ds,de), < t < T, a.s. 
Jt Je 

with 

U t (e) < 0, dP® dt ® A(de) a.e. on Q x [0,T] x A. (2.2) 

Definition 2.1 A minimal solution to the BSDE with terminal data/generator (t;,F) and 
A-nonpositive jumps is a quadruple of processes (Y,Z,U,K) £ S 2 x L 2 (W) x L 2 (/2) x K 2 
satisfuina ([2"?T) - ([23j) such that for any other quadruple (Y,Z,U,K) G S 2 xL 2 (W) xL 2 (/I) x 
K 2 satisfying (|2.ip - (|2.2p . we have 

Y t < Y t , < t < T, a.s. 

Remark 2.1 Notice that when it exists, there is a unique minimal solution. Indeed, by 
definition, we clearly have uniqueness of the component Y. The uniqueness of Z follows by 
identifying the Brownian parts and the finite variation parts, and then the uniqueness of 
(U, K) is obtained by identifying the predictable parts and by recalling that the jumps of /x 
are inaccessible. By misuse of language, we say sometimes that Y (instead of the quadruple 
(Y, Z, U, K)) is the minimal solution to (j27L>(f!T2"j) . □ 

In order to ensure that the problem of getting a minimal solution is well-posed, we shall 
need to assume: 

(HI) There exists a quadruple (Y,Z,K,U) G S 2 x L 2 (W) x L 2 (/2) x K 2 satisfying 

We shall see later in Lemma 15. II how such condition is satisfied in a Markovian frame- 
work. 




3 Existence and approximation by penalization 
3.1 Penalized BSDE 

In this section, we prove the existence of a minimal solution to (|2.ip - (|2.2p . based on ap- 
proximation via penalization. For each n G N, we introduce the penalized BSDE with 
jumps 

Y t n = £ + j%(s,Y s n ,Z^U*)ds + KZ-K? (3.1) 

ZyW s - f f U?(e)fi(ds,de), < t < T, 
Jt Je 
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where K n is the nondecreasing process in K 2 defined by 

K? = n f [ [U™{e)] + \(de)ds, < t < T. 

Jo J A 

Here [u] + = max(it, 0) denotes the positive part of u. Notice that this penalized BSDE can 
be rewritten as 

Yt = £ + [ T F n (s, Y s n , Z", U*)ds - f T Zyw s - T f U?(e)fl(ds, de), < t < T, 
Jt Jt Jt Je 

where the generator F n is defined by 

F n (t,y,z,u) = F(t,y,z,u) + n [u(e)] + X(de) , 

J A 

for all (t,y,z,u) € [0,T] x R x R d x L 2 (A). Under (HO) (ii)-(iii) and since X(A) < oo, we 
see that F n is Lipschitz continuous w.r.t. (y, z,u) for all n G N. Therefore, we obtain from 
Lemma 2.4 in [21], that under (HO), BSDE (pH]) admits a unique solution (Y n , Z n , U n ) G 
S 2 x L 2 (W) x L 2 (/2) for any n G N. 

The rest of this section is devoted to the convergence of the sequence (Y n , Z n , U n , K n ) n 
to the minimal solution we are interested in. 

3.2 Comparison results 

Lemma 3.1 Let Assumption (HO) holds. The sequence (Y n ) n is nondecreasing, i.e. Y™ 
< Y t n+1 for all t G [0, T] and all n G N. 

Proof. Fix n G N, and observe that 

F n (t,e,y,z,u) < F n+1 (t,e,y, z,u), 

for all (t,e,y,z,u) G [0, T] x E x M. x E d x L 2 (A). Under Assumption (HO), we can apply 
the comparison Theorem 2.5 in [22], which shows that Y t n < Y t n+1 , < t < T, a.s. □ 

The next result shows that the sequence (Y n ) n is upper-bounded by any solution to the 
constrained BSDE. 

Lemma 3.2 Let Assumption (HO) holds. For any quadruple (Y, Z, U, K) G S 2 x L 2 (W) x 
L 2 (/I) x K 2 satisfying (f27TT) - ff2T2]) . we have 

Yt < Y t , < t < T, n G N. (3.2) 

Proof. Fix n G N, and consider a quadruple (Y,Z,U,K) G S 2 x L 2 (W) x L 2 (/i) x K 2 
solution to (gUJ-Q). Then, U clearly satisfies J* f A [U s (e)} + \(de)ds = for all t G [0,T], 
and so (Y,Z,U,K) is a supersolution to the penalized BSDE f)3. 1 [) . i.e: 

? t = £ + J% n (s,Y s ,Zs,U s )ds + K T -K t 

- [ Z s dW s - f [ U s (e)fl(ds,de), < t < T. 
Jt Jt Je 

By applying the comparison result in Theorem IA.1I under (HO), we obtain the required 
inequality: Y t n < Y t , < t < T. □ 
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3.3 Convergence of the penalized BSDEs 

We now establish a priori uniform estimates on the sequence (Y n , Z n , U n ,K n ) n . 

Lemma 3.3 Under (HO) and (HI), there exists some constant C depending only on T 
and the monotonicity condition of F in (HO) (Hi) such that 



I Y n II 2 -|- \\Z n ^ 2 



L 2 (W) 

T 



+ ||CH| 2 2 + ||K n || 2 

L (A) S2 



< C E|£|^+E / |F(t,0,0,0)pft 



+ E[ sup \Y t \ 

0<t<T 



Vn e N. 



(3.3) 



Proof. In what follows we shall denote by C > a generic positive constant depending 
only on T, and the linear growth condition of F in (H0)(ii), which may vary from line to 
line. By applying Ito's formula to |i^ n | 2 , and observing that K n is continuous and AI7 1 = 
f E UZ l (e)n({t},de), we have 



E|£| 2 = E|y 4 n | 2 -2E/ Y s n F(s, Y s n , Z s n , U™)ds - 2E I Y s n dK™ + E / \Z r s fds 

Jt Jt Jt 

+ E [ T [ {\Y s ^ + U^e)\ 2 -\Y s n _\ 2 -2Y s n _U^e)} f ,(de,ds) 

Jt JE 

E|y™| 2 + E/" \Z?\ 2 ds + E [ [ \U^{e)\ 2 X{de)ds 



t JE 



-2E f Y s n F(s, Y s n , Z n s , U™)ds - 2E f Y s n dK^, < t < T. 
Jt Jt 

From (HO) (hi), the inequality Y™ < Yj by Lemma 13.21 under (HI), and the inequality 2ab 
< ^-a 2 + ab 2 for any constant a > 0, we have: 

E\Y t n \ 2 +E [ T \Z"\ 2 ds + E [ T i \U2(e)\ 2 X(de)ds 

Jt Jt J E 

< m 2 + CE jf \Y?\ (1^,0,0,0)1 + \Y s n \ + \Z?\ + \U?\^ W 

+ aE\K% - K?\ 2 . 



ds 



+ -E 

a 



sup \Y S 

se[o,T] 



2 l2 

Using again the inequality ab < \ + -j, and (H0)(i), we get 



Eivnp + ze I \Z 1 }\ z ds + -E 



1, 



n|2. 



1, 



T 



t JE 



U™(e)\ 2 \(de)ds 



T 



< CE I \Y s n \ 2 ds + E\C\' z + ^E / \F{s,0,0,0)\' z ds + -E 



1. 



sup | it | 

t£[0,T] 



(3.4) 

+ aE\K^ - K?\ 2 . 



Now, from the relation (|3.1|) . we have: 



F( S ,Y s n ,Z?,U?)d S 



+ I zyw a + 



t JE 



Ug(e)p,(ds,de), 
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there exists some positive constant C\ depending only on the linear growth condition of F 
in (HO)(ii) such that 

E\K^-K?\ 2 < Ci(E|£| 2 + E J |F(s,0,0,0)| 2 (is + E|y™| 2 

+ e£ {\Y s n \ 2 + \ZZ\ 2 + \U?\l 2 Jds), 0<t<T. (3.5) 

Hence, by choosing a > s.t. C±a < 4, and plugging into (|3.4p . we get 



E|^ n | 2 + 4e / \Zl l \ 2 ds + T E 



3_,„„,o 1 
< CE \Y s n \ 2 ds + ^E\£\ 2 



t JE 



U™{e)\ 2 \{de)ds 



1 f T 1 - 

+ -E / \F(s,0,0,0)\ 2 ds + -El" sup |K 

4 7o « S6[0,T] 



< i < T. 



Prom Gronwall's lemma to t \— > E|l^ n | 2 , we thus obtain: 



sup E|y t n | 2 + E / \Z?\*dt + R 



0<t<T 



yn\2. 



JE 



U?(e)\ 2 \(de)dt 



< c(e\£\ 2 +e[ \F(t,0,0,0)\ 2 dt + E[ sup \Y t 
^ Jo te[o,T] 



(3.6) 



which gives the required uniform estimates (|3.3p for (Z n ,U n ) n and also (K n ) n by (|3,5D . 
Finally, by writing from f|3. 1 1) that 



sup < [ T \F(t,Yr,z?,un\dt+Kz 

0<t<T JO 



+ sup 

0<t<T 



+ sup 

0<t<T 



U™(e)fi(ds,de) 



JE 



we obtain the required uniform estimate (|3.3|) for (Y n ) n by Burkholder-Davis-Gundy in- 
equality, linear growth condition in (HO)(ii), and the uniform estimates for (Z n , U n ,K n ) n . 

□ 



We can now state the main result of this Section. 



Theorem 3.1 Under (HO) and (HI), there exists a unique minimal solution (Y, Z,U, K) 
G S 2 x L 2 (W) x L 2 (/I) x K 2 with K predictable, to (pTTj) - (pI2|) . Y is the increasing limit of 
{Y n ) n and also in L 2 (0,T), K t is the weak limit of (K?) n in L 2 (f2, J" t ,P) for allt G [0,T], 
and for any p G [1,2), 

\\ Zn ~ ^IIlp(w) + - ^IIlp(m) y °> 

as n goes to infinity. 

Proof. By Lemmata 13.11 and 13.21 (Y n ) n converges increasingly to some adapted process 
Y, which is actually in S 2 by the uniform estimate for (Y n ) n in Lemma 13.31 and Fatou's 
lemma. Moreover by dominated convergence theorem, the convergence of (Y n ) n to Y also 
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hold in L 2 (0,T). Next, by the uniform estimates for (Z n ,U n , K n ) n in Lemma 13.31 we 
can apply the monotonic convergence Theorem 3.1 in [9], which extends to the jump case 
the monotonic convergence theorem of Peng [T7] for BSDE. This provides the existence of 
(Z, U, K) E L 2 (W) x L 2 (jl) x K 2 with K predictable, such that the sequence {Z n , U n , K n ) n 
converges in the sense of Theorem 13.11 to (Z, U, K) satisfying: 

Y t = £ + ^ F(s,Y s ,Z s ,U s )ds + K T - K t 

- [ Z s dW s - [ [ U s (e)fl(ds,de), < t < T. 

Jt Jt J E 

Moreover, from the strong convergence in L 1 (/l) of (U n ) n to U and since X(A) < oo, we 
have 

E / / [U™(e)] + \{de)ds — > E f [ [U s (e)} + X(de)ds, 

JO J A JO J A 

as n goes to infinity. Since K^ = n Jo f A [U™(e)] + \(de)ds is bounded in L 2 (ft, F T , P), this 
implies 

E f [ [U s (e)] + \{de)ds = 0, 



JO J A 

which means that the ^4-nonpositive constraint (|2.2p is satisfied. Hence, (Y, Z, K, U) is a 
solution to the constrained BSDE (|2,ip - (|2.2p . and by Lemma [3. 2\ Y = lim Y n is the minimal 
solution. Finally, the uniqueness of the solution (Y, Z, U, K) is given by Remark 12.11 □ 

4 Dual representation 

In this section, we consider the case where the generator function F(t,u>) does not depend 
on y, z, u. Our main goal is to provide a dual representation of the minimal solution to the 
BSDE with A-nonpositive jumps in terms of a family of equivalent probability measures. 

Let V be the set of V <g> £>(-E)-measurable processes valued in (0, oo), and consider for 
any v £ V, the Doleans-Dade exponential local martingale 



L\ := S[ I" f (u s (e)-l)pi(ds,de))^ 



'0 J E Jt 

= exp [J lnv s (e)n(ds,de) - J {v s {e) - l)A(de)ds), < t < T. (4.1) 

When L u is a true martingale, i.e. E[L^] = 1, it defines a probability measure ¥ u equivalent 
to P on (fi, Tt) with Radon-Nikodym density: 



dF u 
~d¥ 



= L v t , 0<t<T, (4.2) 

■Ft 



and we denote by E^ the expectation operator under ¥ u . Notice that W remains a Brownian 
motion under P v , and the effect of the probability measure ¥ u , by Girsanov's Theorem, is 
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to change the compensator X(de)dt of fi under P to v t (e)X(de)dt under P v . We denote by 
fx y {dt,de) = fi(dt,de) — h , t (e)X(de)dt the compensated martingale measure of \i under P u . 
We then introduce the subset Va of V by: 

Va = |^ G V, valued in [l,oo) and essentially bounded : 

v t {e) = 1, e £ £ \ i, dF®dt®X(de) a.e.j, 
and the subset V\ as the elements of v G essentially bounded by ra + 1, for n G N. 

Lemma 4.1 For any u G V,4, is a uniformly integrable martingale, and is square 
integrable. 

Proof. Several sufficient criteria for L v to be a uniformly integrable martingale are known. 
We refer for example to the recent paper |21j . which shows that if 



:= exp(^ J \u t (e)-l\ 2 X(de)dt S j 



is integrable, then L u is uniformly integrable. By definition of Va, we see that for v G Va, 

cT 



s. 



T 



exp 



o 



\vt{e) - l\ 2 X(de)dtj, 



which is essentially bounded since v is essentially bounded and X(A) < oo. Moreover, from 
the explicit form (JJIJ) of we have \L V T \ 2 = L^S£, and so E\L^\ 2 < H^Hoo- □ 



We can then associate to each v G Va the probability measure ¥ u through (|4.2p . We 
first provide a dual representation of the penalized BSDEs in terms of such P". To this 
end, we need the following Lemma. 

Lemma 4.2 Let 4> G L 2 (W) and ip G L 2 (/2). Then for every v G Va, the processes 
J Q 4>tdWt and j J E tpt(e)ll u (dt,de) are ¥ u -martingales. 

Proof. Fix (f) G L 2 (W) and v G Va and denote by the process cf>tdWt- Since 
W remains a P^-Brownian motion, we know that is a P^-local martingale. From 
Burkholder-Davis-Gundy and Cauchy Schwartz inequalites, we have 



E u 


sup \M?\ 


< CE U 




L te[o,T] 





(Mt>), 



CE 



T 



^t\ 2 dt 



< C\E 



\TV 12 

I -L- jr p i 



'E 



T 



\ 2 dt 



JO 



< OO, 



since is square integrable by Lemma |4.1| and cj) G L 2 (W). This implies that is P w - 
uniformly integrable, and hence a true P^-martingale. The proof for j Q j E <j)t(e)fl u (dt,de) 
follows exactly the same lines and is therefore omitted. □ 
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Proposition 4.1 For all n G N, the solution to the penalized BSDE (|3.ip is explicitly 
represented as 



Y t n = ess sup E u £ + / F(s)ds 



, < t < T. 



(4.3) 



Proof. Fix n G N. For any G V^, and by introducing the compensated martingale 
measure jl u (dt,de) = jl(dt,de) — (fi(e) — l)X(de)dt under F u , we see that the solution 
{Y n ,Z n ,U n ) to the BSDE (ELD satisfies: 



17' 



T [F( S )+ / (n[U™{e)] + -{v s {e)-l)U^{e))\{de) 



ds 



(4.4) 



r 



(i/ a (e) - l)U™{e)\{de)ds 



T 



Z n a dW, 



T 



t JE 



It JE\A 

By definition of Va, we have 

r-T 

By taking expectation in (|4.4p under (~ P), we then get from Lemma 14.21 

r-T 



U™(e)fi u (ds,de). 



[ [ (v s (e) - l)U™(e)\(de)ds = 0, < t < T, a.s. 
Jt Je\a 
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E" 



e + jf + J a {n[U?(e)] + - (u s (e) - l)U« (e)) \(dej) ds 



Now, observe that for any v G V^, hence valued in [1, n + 1], we have 

n[U?{e)] + - [y t {e) - l)U?{e) > 0, dP ® dt ® A(cfe) a.e. 
which yields by f[4.5j) : 



If > ess sup E" £ + / F(s)ds 



On the other hand, let us consider the process u* G V\ defined by 



"t(e) = (%(e)<o + (w + l)l % (e)>oJle6A, < t < T, e G E. 

By construction, we clearly have 

n[[/™(e)] + -K(e)-l)C/ t "(e) = 0, V0 < t < T, e G A, 
and thus for this choice oiv = v* in (14.51): 



17' 



E^ 



£+ / F(s)ds 



(4.5) 



(4.6) 



Together with (|4.6|) . this proves the required representation of K n . 



□ 
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Remark 4.1 Arguments in the proof of Proposition 14. 1 1 shows that the relation (|4.3p holds 
for general generator function F depending on (y,z,u), i.e. 



ess sup E 1, 



T 



£ + / F(s,Y s n ,Z^,U^ds 



T 



which is in this case an implicit relation for Y n . Moreover, the essential supremum in this 
dual representation is attained for some u* , which takes extreme values 1 or n + 1 depending 
on the sign of U n , i.e. of bang-bang form. □ 

Let us then focus on the limiting behavior of the above dual representation for Y n when 
n goes to infinity. 

Theorem 4.1 Under (HI), the minimal solution to (|2.ip - (|2.2p is explicitly represented as 



Y 



ess sup E" £+ / F(s)ds 



T 



0<t<T. 



(4.7) 



Proof. Let (Y, Z, U, K) E be the minimal solution to (f2Tl>(f2T2"j) . Let us denote by Y the 
process defined in the r.h.s of (|4.7p . Since V\ C Va, it is clear from the representation (|4.3p 
that Y™ < Yt, for all n. Recalling from Theorem 13.11 that Y is the pointwise limit of Y n , 
we deduce that Y t = lim n ^ 00 Y t n < Y t , < t < T. 

Conversely, for any v G Va, let us consider the compensated martingale measure 
fL u (dt, de) = jl(dt, de) — [yt (e) — l)X(de)dt under ¥ v , and observe that (Y, Z, U, K) satisfies: 

rT 



Y 



F(s) 



(i/ a (e) - l)U s (e)X(de) 



t JE\A 



(u s (e) - l)U s {e)\{de)ds 



ds + K T - K t 



Z,dW, 



(4.8) 



U s (e)jl u (ds, de). 



By definition of v G Va, we have: f t j E ^ A {v s {e) — l)U s (e)\(de)ds = 0. Thus, by taking 
expectation in (j4.8|) under ¥ u from Lemma 14.21 an d recalling that K is nondecreasing, we 
have: 

-T 



Y t > E u 
> E^ 



F(s)- / (u s (e)-l)U s (e)\(de))ds 



F(s)ds 



Tt 



since v is valued in [l,oo), and U satisfies the nonpositive constraint (|2.2p . Since v is 
arbitrary in Va, this proves the inequality Yt > Yt, and finally the required relation Y = 
Y. a 



5 Nonlinear IPDE and Feynman-Kac formula 

In this section, we shall show how minimal solutions to our BSDE class with partially 
nonpositive jumps provide actually a new probabilistic representation (or Feynman-Kac 
formula) to fully nonlinear integro-partial differential equation (IPDE) of Hamilton- Jacobi- 
Bellman (HJB) type, when dealing with a suitable Markovian framework. 
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5.1 The Markovian framework 

We are given a compact set A of R 9 , and a Borelian subset L C M! \ {0}, equipped with 
respective Borel <7-fields 13(A) and B(L). We assume that 

(HA) The interior set A of A is connex, and A = Adh(A), the closure of its interior. 

We consider the case where E = L U A and we may assume w.l.o.g. that L n A = 
by identifying A and L respectively with the sets A x {0} and {0} x L in f x M ! . We 
consider two independent Poisson random measures $ and tt defined respectively on R + x L 
and R+ x A. We suppose that $ and 7r have respective intensity measures X$(dl)dt and 
X- K (da)dt where \$ and A, are two cr-finite measures with respective supports L and A, and 
satisfying 

J (1 A \£\ 2 )X#(d£) < oo and /^A^da) < oo , 

and we denote by $(dt, d£) = dl) — X${dt)dt and fr(dt, da) = n(dt, da) — X 7T (da)dt the 
compensated martingale measures of $ and 7r respectively. We also assume that 

(HA,) 

(i) The measure A, supports the whole set A: for any a € A and any open neighborhood 
O of a in R q we have A 7r (C n A) > 0. 

(ii) The boundary of A: dA = A \ A, is negligible w.r.t. A,, i.e. X n (dA) = 0. 

In this context, by taking a random measure fx on R+ x £ in the form, (i = •& + 7r, we 
notice that it remains a Poisson random measure with intensity measure X(de)dt given by 

(p(e)X(de) = / (p(£)\#(d£) + / ip(a)X w (da) , 

for any measurable function <p from to R, and we have the following identifications 

L 2 (/2) = L 2 (tf) x L 2 (^) , L 2 (A) = L 2 (A„) x L 2 ^) , (5.1) 

where 

• L 2 (#) is the set of V ® £>(L)-measurable maps U : ft x [0, T] x L ->■ R such that 







|?7t(f)rAtf(cK)dt 



2 

< OO 



• L 2 (7f) is the set of V ® £> (^-measurable maps R : $7 x [0, T] x A -> R such that 



lL 2 (ff) ' E 



L JO JL 

2/ 



T 

i^(a)| 2 A^(da)dt 



i 

2 

< OO 



L (A$) is the set of ^(L)-measurable maps u : L — > R such that 



i 

2 

< CO , 
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L 2 (A 7r ) is the set of £>(^4)-measurable maps r : A — > R such that 

\r(a)\ 2 \v(da)^} 2 < oo . 



Given some measurable functions b : R d x R q -)• IR d , a : R d x M 9 ->• M dxci and /3 : 
IR d x R q x L — > R d , we introduce the forward Markov regime-switching jump-diffusion 
process (X, I) governed by: 

dX s = b(X s ,I s )ds + a(X s ,I s )dW s + J /3(X s -,I s -,£)#(ds,d£), (5.2) 
dl s = / (a — I s -^ir(ds,da). (5.3) 



.4 



In other words, / is the pure jump process valued in A associated to the Poisson random 
measure ir, which changes the coefficients of jump-diffusion process X. We make the usual 
assumptions on the forward jump-diffusion coefficients: 

(HFC) 

(i) There exists a constant C such that 

\b(x,a) -b(x',a')\ + \a(x,a) - a(x',a')\ < C(\x - x'\ + \a - a'\) , 
for all x, x' e R d and a, a' G R q . 

(ii) There exists a constant C such that 

\(3(x,a,£)\ < C(l + |x|) (l A \£\), 
\/3(x,a,e) - /3(x',a',e)\ < C(\x-x'\ + \a-a'\)(lA\£\), 

for all x, x' G R d , a, a' G M q and £ G L. 

Under these conditions, existence and uniqueness of a solution (X t / X ' a , lt' a )t<s<T to (|5.2|) - 
(|5.3p starting from (x,a) G M. d x K 9 at time s = t G [0, T], is well-known, and we have the 
standard estimate: for all p > 2, there exists some positive constant C p s.t. 



E 



|j^-t,a;,a|p _|_ |jt,a|p 

L t<s<T 



for all (t, x, a) G [0, T] x R d x 



< C p (l + \x\p + \a\ p ) , (5.4) 



In this Markovian framework, the terminal data and generator of our class of BSDE are 
given by two continuous functions g: R d x R q -)• R and / : R d x R q x R x M d x L 2 (A^) -)• R. 
We make the following assumptions on the BSDE coefficients: 

(HBC1) 

(i) The functions g and /(., 0,0,0) satisfy a polynomial growth condition: 

|g(x,q)| + a ,0,0,0)| 
sup 1— : — < oo, 

j ] A- \'r\'m ± \n\ m 

x£R d , aSRi ^ I ^ l M l 

for some m > 0. 
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(ii) There exists some constant C s.t. 

\f(x, a, y, z, u) - f(x', a', y' , z' , u')\ 
< C(\x - x'\ + \a- a'\ + \y- y'\ + \z- z'\ + \u- u'| L a( Atf) ) , 

for all x,x' G R d , y,y' G R, z,z' G R d , a, a' G R" and u,u' G L 2 (A^»). 
(HBC2) The generator function / satisfies the monotonicity condition: 

f(x,a,y,z,u)-f(x,a,y,z,u') < / j(x, a, £, y, z, u, u')(u(£) - u'(£))X»(d£) 



for all x G R d , a G R q , z G R d , y G R and u,u' G L 2 (A^), where 7:R d x£xRxR d x 
L 2 (A^)xL 2 (A tf ) ^Misai3(M d )®S(E)®^(R)«)^(M' i )®^(L 2 (A^))(g)i3(L 2 (A tf ))-measurable 
map satisfying: Ci(l A \£\) < j(x, a, £, y, z, u, u') < 6*2(1 A \£\), for £ G L, with two constants 

-1< Ct < < c 2 . 

Let us also consider an assumption on the dependence of / w.r.t. the jump component 
used in [2], and stronger than (HBC2). 

(HBC2') The generator function / is of the form 

f(x,a,y,z,u) = h(x,a,y,z,J u{£)8(x,£)\$(d£)) 

for (x, a, y, z, u) G R d x R q x R x R d x L 2 (A), where 

• 5 is a measurable function on R d x L satisfying: 

< 5(x,£) < C(1A\£\), 
\5{x,£)-5{x',£)\ < C\x-x'\(lA\£\ 2 ), x,x'eR d ,£eL, 

for some positive constant C. 

• h is a continuous function on x 1' x K x l 1 * x I such that p 1— > h(x, a,y, z, p) is 
nondecreasing for all (x, a,y,z) G R d x R 9 x R x R d , and satisfying for some positive 
constant C: 

\h(x,a,y,z,p) - h(x, a,y, z, p')\ < C\p-p'\, p, p' G R, 
for all (a;, a,y,z) G R d x R 9 x R x R d . 



Now with the identification ([53]) . the BSDE problem pj|l - (j2\2|l takes the following 
form: find the minimal solution (Y,Z,U,R,K) G S 2 x L 2 (W) x L 2 (tf) x L 2 (n) x K 2 to 



Y t = g(X T ,I T ) + j T f(X s ,I s ,Y s ,Z s ,U s )ds + K T -K t 



Z s .dW s - [ [ U s (£)$(ds,d£) - [ [ R s (a)n(ds,da), (5.5) 
Jt J L Jt J A 



18 



with 



R t (a) < 0, dF®dt® X n (da) a.e. (5.6) 



The main goal of this paper is to relate the BSDE (|5.5p with ^4-nonpositive jumps (|5,6 
to the the following nonlinear IPDE of HJB type: 



dw 

"aT ~ SU P 

at a€A 



C a w + f(.,a,w,a T (.,a)D x w,M a w) = 0, on [0,T)xi d , (5.7) 



w(T,x) = supg(x,a), x E M. d , (5.8) 

aeA 



where 



C a w(t,x) = b(x, a).D x w(t, x) + -ti(aa T (x, a)D^w(t, x)) 



[w(t, x + /3(x, a, £)) — w(t, x) — f3(x, a, £).D x w(t, x)] A$(d£), 

L 

M a w(t,x) = (w(t,x + P(x,a,£)) -w(t,x)) ieL , 
for (t,x,a) G [0,T] x R d x W. 

Notice that under (HBC1), (HBC2) and (which follows from (HFC)), and 

with the identification (|5.ip . the generator F(t,oj,y, z,u,r) = f(X t (uj),It(uj),y 1 z,u) and 
the terminal condition £ = q(Xt,It) satisfy clearly Assumption (HO). Let us now show 
that Assumption (HI) is satisfied. More precisely, we have the following result. 

Lemma 5.1 Let Assumptions (HFC), (HBC1) hold. Then, for any initial condition 
{t,x,a) G [0,T] x R d x R«, tfiere exists a sotoion {(Y" s * ' x ' a , Z*' x,a , C/i'^, i?i' x ' a , i^' x ' a ), t < 
s <T} to the BSDE (j5T5>(jO|l w/ierc (X,/) = {(X^' a , / s *' a ), t < s < T}, with Y s t,x,a = 
v(s, X t s ' x,a ) for some deterministic function v on [0, T] x M d satisfying a polynomial growth 
condition: for some p > 2, 

sup ' < oo . (5.9) 

{t,x)e[0,T]xR d 1 + l x r 

Proof. Under (HBC1) and since A is compact, we observe that there exists some m > 
such that 

|g(x,a)| + |/(x,a,y,z,-u)| 
Cf := sup — — — — < oo. (5.10) 

\atA 1 + \ x \ m + \V\ + \ z \ + \ u k 2 (\o) 



Let us then consider the smooth function v(t, x) = Ce p ^ T ~ t \l + |^| p ) for some positive 
constants C and p to be determined later, and with p = max(2,m). We claim that for 
C and p large enough, the function v is a classical supersolution to f)5.T|) - (|5.8j) . Indeed, 
observe first that from the growth condition on g in (|5. 10p . there exists C > s.t. g(x) : = 
su PaeA 9( x i a ) — C(l + \x\ p ) for all x G M. d . For such C, we then have: v(T, .) > g. On the 
other hand, we see after straightforward calculation that there exists a positive constant 
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C depending only on C, Cf >g , and the linear growth condition in x on b, a, (3 by (HFC) 
(recall that A is compact), such that 



dv 

at aeA L 



C a v + f(.,a,v,a T (.,a)D x v,M a v) > (p - C)v 

> 0, 

by choosing p > C. Let us now define the quintuple (Y, Z, U, R, K) by: 

Y t = v(t,X t ) for t<T, Y T = g(X T ,I T ), 

Z t = a^(X t -J t -)D x v(t,X t -), t<T, 

M^-v(t,X t -), R t = 0, t < T 
r-t _ 



K t 
K T 



^(s, X s ) - C h v(s, X s ) - f(X s , I S ,Z S , U s 
K T -+v{T,X T )-g(X T ,I T ). 



ds, t <T 



From the supersolution property of v to (|5.7p - (|5.8p . the process K is nondecreasing. More- 
over, from the polynomial growth condition on v, linear growth condition on b, a, growth 
condition ()5.10|) on /, g and the estimate (|5.4j) . we see that (Y , Z ,U , R, K) lies in S 2 x 
L 2 (W) x L 2 (ij) x L 2 (tt) x K 2 . Finally, by Ito's formula to v(t,X t ), we conclude that 
(Y , Z ,U , R, K) is solution to (I5.5p . and the constraint (I5.6P is trivially satisfied. □ 

Under (HFC), (HBC1) and (HBC2), we then get from Theorem 13.11 the existence 
of a unique minimal solution {(Y s t ' x > a ,Zp x ' a ,Ut' x ' a ,R s ' x ' a ,K t s ' x ' a ), t < s < T} to rf53]) - rf5^]) 
when (X,I) = {(Xt' x ' a , f s ' a ), t<s<T}. Moreover, as we shall see in the next paragraph, 
this minimal solution is written in this Markovian context as: Y s t,x,a = v(s, Xl' x ' a , lt' x ' a ) 
where v is the deterministic function defined on [0, T] x R d x R 9 — > M by: 



v(t, x, a) 



Y 



t,x,a 



(t, x, a) G [0, T] x R d x 



(5.11) 



We aim at proving that the function v defined by ()5.1ip does not depend actually on its 
argument a, and is a solution in a sense to be precised to the parabolic IPDE (15.7p - (15.8D . 
Notice that we do not have a priori any smoothness or even continuity properties on v. 

To this end, we first recall the definition of (discontinuous) viscosity solutions to (|5.7D - 
(|5.8p . For a locally bounded function w on [0,T) x R d , we define its lower semicontinuous 
(lsc for short) envelope w*, and upper semicontinuous (use for short) envelope w* by 



w*(t,x) = liminf w(t',x') and w*(t,x) 

{t',x') -¥ (t, x) 
t' < T 



limsup w(t,x) 

(t' , x 1 ) —t (t, x) 
t' < T 



for all (f , x) £ [0, T] x 



Definition 5.1 (Viscosity solutions to (|5.7p - (|5.8p ) 

(i) A function w, lsc (resp. use) on [0, T] x R d , is called a viscosity supersolution (resp. 
subsolution) to (I5.7p - (l5.8p if 

w(T,x) > (resp. <) supg(x,a) , 

a£A 
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for any x G R d , and 
/or any (t,x) G [0, T) x M d and any ip G C 1>2 ([0,T] x R d ) such that 



% -sup \£ a <p + f(., a, w,o-T{.,a)D x <p,M a <p)])(t,x) > {resp. <) 0, 



(u> — c/?)(i, cc) = min (u> — ip) {resp. max (n> — ip)) . 

[0,T]xRrf [0,T]xB<* 

(ii) A locally bounded function w on [0,T) xR d is called a viscosity solution to (|5.7p - (|5,8p 
i/io* is a viscosity supersolution and w* is a viscosity subsolution to (|5.7p - (|5.8p . 

We can now state the main result of this paper. 

Theorem 5.1 Assume that conditions (HA), (HX W ), (HFC), (HBC1), and (HBC2) 
hold. The function v in (|5.1ip does not depend on the variable a on [0,T)xlxi i.e. 

v{t,x,a) = v{t,x,a), V a,a G A, 

for all (t,x) G [0, T) x R d . Let us then define by misuse of notation the function v on 
[0, T) x R d by: 

v{t,x) = v{t,x,a), (t, x) G [0, T) x R d , (5.12) 

for any a £ A. Then v is a viscosity solution to (|5.7p and a viscosity subsolution to (|5.8p . 
Moreover, if (HBC2') holds, v is a viscosity supersolution to 



Remark 5.1 1. Once we have a uniqueness result for the fully nonlinear IPDE (|5.7p - (|5.8p . 
Theorem 15.11 provides a Feynman-Kac representation of this unique solution by means 
of the minimal solution to the BSDE (|5.5p - (|5.6p . This suggests consequently an original 
probabilistic numerical approximation of the nonlinear IPDE (I5.7p - (l5.8p by simulation of the 
associated penalized BSDE with jumps {Y n , Z n , U n , R n ), which relies also on the simulation 
of the forward jump-diffusion process {X,I). 

2. We do not address here comparison principles (and so uniqueness results) for the general 
parabolic nonlinear IPDE (j5.7[) - ()5.8|) . In the case where the generator function f{x, a) does 
not depend on {y,z,u) (see Remark 15.21 below) . comparison principle is proved in [19], and 
the result can be extended by same arguments when f{x, a, y, z) depends also on y, z under 
the Lipschitz condition (HBCl)(ii). When / also depends on u, comparison principle is 
proved by [2] in the semilinear IPDE case, i.e. when A is reduced to a singleton, under 
condition (HBC2'). We also mention recent results on comparison principles for IPDE in 
[3] and references therein. □ 

Remark 5.2 Stochastic control problem 

1. Let us now consider the particular and important case where the generator f{x,a) does 
not depend on (y,z,u). We then observe that the nonlinear IPDE (|5.7|) is the Hamilton- 
Jacobi-Bellman (HJB) equation associated to the following stochastic control problem: let 
us introduce the controlled jump-diffusion process: 

dXf = b{Xf,a s )ds + a{Xf,a s )dW s + J i(Xf-,a s ,l)#(ds,d£), (5.13) 
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where W is a Brownian motion independent of a random measure tfona filtered probability 
space (fl, F, F°,P), the control a lies in A&o, the set of F°-predictable process valued in A, 
and define the value function for the control problem: 

w(t,x) := sup E[ f f{X t f^,a s )ds + g{X t r f' a 1 a T )\ 1 (t,x) £ [0,T] xR d , 

where {X 1 ^' 01 ,t < s < T} denotes the solution to (|5. 13[) starting from x at s = t, given 
a control a £ Ap->. It is well-known (see e.g. [19] or |14] ) that the value function w is 
characterized as the unique viscosity solution to the dynamic programming HJB equation 
(|5.7p - (|5.8p . and therefore by Theorem 15.11 w = v. In other words, we have provided a 
representation of fully nonlinear stochastic control problem, including especially control in 
the diffusion term, in terms of minimal solution to the BSDE (|5.5p - (l5.6p . 
2. Combining the BSDE representation of Theorem 15.11 together with the dual representa- 
tion in Theorem l4.1| we obtain an original representation for the value function of stochastic 
control problem: 



sup E 



F f(X?,a t )dt + g(X%,a T )} = sup E" [ / f(X t , I t )dt + g(X T , I T ) 

JO J v&Va l J0 



The r.h.s. in the above relation may be viewed as a weak formulation of the stochastic 
control problem. Indeed, it is well-known that when there is only control on the drift, the 
value function may be represented in terms of control on change of equivalent probability 
measures via Girsanov's theorem for Brownian motion. Such representation is called weak 
formulation for stochastic control problem, see [7]. In the general case, when there is 
control on the diffusion coefficient, such "Brownian" Girsanov's transformation can not be 
applied, and the idea here is to introduce an exogenous process I valued in the control set 
A, independent of W and ?9 governing the controlled state process X a , and then to control 
the change of equivalent probability measures through a Girsanov's transformation on this 
auxiliary process. □ 



The rest of this paper is devoted to the proof of Theorem 15.11 

5.2 Viscosity property of the penalized BSDE 

Let us consider the Markov penalized BSDE associated to (|5.5p - (|5.6p : 

Y? = g(X T ,I T ) + [ T f(X s ,I s ,Y?, Z« U2)ds + n F f [B%(a)}+ X n (da)ds 

Jt Jt J A 

- [ Z n s .dW s - [ [ U™(l)${ds,dl) - [ [ R^(a)n(ds,da) , (5.14) 
Jt Jt Jl Jt J A 

and denote by {(Yj 1 ' ,x ' a , z™'*' x ' a , [/£ l >*» a! » ) _R"'*' x,a ) i t < s <T} the unique solution to (|5.14p 
when (X, I) = {(Xi' x ' a , 4' a ), t < s < T} for any initial condition (t, x, a) G [0, T) x R d x R q . 
From the Markov property of the jump-diffusion process (X,I), we recall from [2] that 
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Y s ' — v n (s,X s ' ' , Is' )j t ^ s ^ T 1 , where ti n is the deterministic function defined on 
[0, T] x R d x R« by: 

v„(t,x,a) := y™'*- x ' a , (t,x,a) G [0,T] x R d x M 9 . (5.15) 

From the convergence result (Theorem 13, ip of the penalized solution, we deduce that the 
minimal solution of the constrained BSDE is actually in the form Y s t,x,a = v(s, Xl' x ' a , ll' a ), 
t < s < T, with a deterministic function v defined in (|5.1ip . 

Moreover, from the uniform estimate (|3.3p and Lemma |5.1| there exists some positive 
constant C s.t. for all n, 

\v n (t,x,a)\ 2 < c(E| 5 (X^^4 a )| 2 +E[^ T |/(X^^^^0,0,0)| 2 ( ^ S 



+ E 



sup I^X^)!' 

L t<s<T 



for all (t, x, a) G [0, T] x R d x M«. From the polynomial growth condition in (HBCl)(i) for 
g and /, (|5.9p for v, and the estimate (|5.4p for (X,I), we obtain that v n , and thus also u 
by passing to the limit, satisfy a polynomial growth condition: there exists some positive 
constant C v and some p > 2, such that for all n: 

|v n (t,x,a)| + K*,x,o)| < C v (l + \x\ p + \a\ p ), V(t, x, a) G [0, T] x R d x M 9 . (5.16) 

We now consider the parabolic semi-linear penalized IPDE for any n: 

dv 

- -^-(*> x ' a ) ~ £ av n(t, x, a) - f[x, a, v, a J (x, a)D x v, M a v) (5.17) 

[v n (t,x,af) - v n (t,x,a)]X 7r (da') 



-n / [v n (t,x,a') - v n {t,x,a)] + \ n (da') = 0, on [0, T) x R d x M 9 , 

u„(r,.,.) = ff, onR^xR". (5.18) 

From Theorem 3.4 in Barles et al. [2], we have the well-known property that the pena- 
lized BSDE with jumps (|3.ip provides a viscosity solution to the penalized IPDE ()5. 17[) - 
(j5. 18|) . Actually, the relation in their paper is obtained under (HBC2'), which allows the 
authors to get comparison theorem for BSDE, but such comparison theorem also holds 
under the weaker condition (HBC2) as shown in [22], and we then get the following result. 

Proposition 5.1 Let Assumptions (HFC), (HBC1), and (HBC2) hold. The function 
v n in ()5.15p is a continuous viscosity solution to (|5.17p - (j5.18p . i.e. it is continuous on 
[0,T] x R d x R q , a viscosity supersolution (resp. subsolution) to (j5. 18|) / 

v n (T,x,a) > (resp. <) g(x,a) , 

for any (x,a) G R d x R q , and a viscosity supersolution (resp. subsolution) to (|5.17p : 

-^{t,x,a)-C a ip(t,x,a) (5.19) 
-f(x, a, v n (t, x, a), a T (x, a)D x <p(t, x, a),M a (p(t, x, a)) 
— / [<p(t, x,a!) — ip(t, x, a)]X K (da') — n I [<p(t, x, a') — ip(t, x, a)] + \ w (da') > (resp. <) 0, 
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for any (t,x,a) G [0,T) xl^M 5 and any ip G C^QO,? 1 ] x (M d x IR 9 )) sucft i/iat 

(u n — <f)(t, x, a) = min (i> n — ip) (resp. max (u„ — </?)) . (5.20) 

[0,T]xR d xRi [0,T]xR d xR9 

In contrast to local PDEs with no integro-differential terms, we cannot restrict in general 
the global minimum (resp. maximum) condition on the test functions for the definition of 
viscosity supersolution (resp. subsolution) to local minimum (resp. maximum) condition. 
In our IPDE case, the nonlocal terms appearing in ()5. 17|) involve the values w.r.t. the 
variable a only on the set A. Therefore, we are able to restrict the global extremum 
condition on the test functions to extremum on [0, T] x R d x A. More precisely, we have 
the following equivalent definition of viscosity solutions, which will be used later. 

Lemma 5.2 Assume that (H\ n ), (HFC), and (HBC1) hold. In the definition ofv n being 
a viscosity supersolution (resp. subsolution) to (15. 17f) at a point (t,x,a) G [0,T) xM^xi, 
we can replace condition (|5.2U|) by: 

= (v n — (p)(t, x, a) = min (v n — tp) (resp. max (v n — (p)) , 

[0,T]xR d xi [0,T]xR d xA 

and suppose that the test function <p is in C^'OQO,? 1 ] x R d x R 9 ). 

Proof. We treat only the supersolution the subsolution case is proved by same 

arguments, and proceed in two steps. 

Step 1. Fix (t,x,a) G [0, T) x R d x R 9 , and let us show that the viscosity supersolution 
inequality (pU9|) also holds for any test function <p in C 1,2 '°([0, T] x R d x R 9 ) s.t. 

(v n - <p)(t,x,a) = min (v n -(p). (5-21) 

[0,T]xR d xR9 

We may assume w.l.o.g. that the minimum for such test function <p is zero, and let us 
define for r > the function ip r by 

<p r v,x',a') = ^(*', ^, a') (i - ^ ) - (i + + i«r) , 

where C v > and p > 2 are the constant and degree appearing in the polynomial growth 
condition f|5.16j) for v n , $ : R+ ->■ [0, 1] is a function in C°°(]R + ) such that 3>|[o,i] = and 
$|[2,+oo) = 1- Notice that ip r G C^ 2 '°([0,T] xR d x R 9 ), 

(ip r ,D x ip r ,D 2 x ip r ) -> (tp,D x <p,Dl<p) as r -> oo (5.22) 

locally uniformly on [0, T] x R rf x R 9 , and that there exists a constant C r > such that 

\<p r {t',x',a')\ < C r (l + \x'\ p + \a'\ p ) (5.23) 

for all (t', x', a') G [0, Tjxl'x R d . Since <3? is valued in [0, 1] , we deduce from the polynomial 
growth condition (|5.16|) satisfied by v n and (|5.2ip that (p r < v n on [0, T] x R d x R 9 for all 
r > 0. Moreover, we have tp r (t, x, a) = ip(t, x, a) (= i> n (i, x, a)) for r large enough. Therefore 
we get 

(v n - (p r )(t,x,a) = min (y n - ip r ) , (5-24) 

[0,T]xR d xR9 
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for r large enough, and we may assume w.l.o.g. that this minimum is strict. Let {p r k ) k be 
a sequence of function in C 1,2 ([0,T] x (R d x R q )) satisfying (|5.23p and such that 

(<p r k ,D x tplDl<pl) -> (<p r ,D x cp r ,D 2 x <p r ) as k^oo, (5.25) 

locally uniformly on [0, T] x R d x M 9 . From the growth conditions (|5.16p and f)5.23|) on 
the continuous functions v n and (p k , we can assume w.l.o.g. (up to an usual negative 
perturbation of the function p\ for large (x',a')), that there exists a bounded sequence 
(t k ,x k ,a k ) k in [0,T] x R d x R c/ such that 

( u n -fk^k^k^k) = min (u n - ^) . (5.26) 

[0,T]xR d xR9 

The sequence (tk,Xk,dk)k converges up to a subsequence, and thus, by (|5.24j) . (|5.25j) and 
(|5.26p . we have 

(t k ,x k ,a k ) — > (t,x,a), as k — > oo . (5-27) 

Now, from the viscosity supersolution property of v n at (t k ,x k ,a k ) with the test function 
(p k , we have 

-^-(tk,x k , ojfc) - C ak p r k {t k ,x kl a k ) 
-f{x k ,a k ,v n (t k ,x k ,a k ),a T (x k ,a k )D x ip r k (t k ,x k ,a k ),M ak p r k (t k ,x k ,a k )) 



VPk{tk,x k: a') - ip r k (t k ,x k ,a k )]\ n (da') 
-n I [^p r k (t k ,x k ,a) - ^ r k (t k ,x k ,a k )] + X n (da') > 0, 



Sending k and r to infinity, and using (15.221) . (15.251) and (I5.27|) . we obtain the viscosity 
supersolution inequality at (t, x, a) with the test function ip. 

Step 2. Fix (t, x, a) G [0, T) x R d x A, and let (p be a test function in C 1>2 ([0, T] 
such that 



x 



= (v n - (p)(t,x,a) = min (v n -ip). (5.28) 

[0,T]xR d xA 

By same arguments as in (|5.23p . we can assume w.l.o.g. that (p satisfies the polynomial 
growth condition: 

\<p(t',x',a')\ < C(l + \x'\ p + \a'\ p ), (t',x',a') G [0,T] x R d x R«, 

for some positive constant C. Together with (|5.16p . and since ^4 is compact, we have 

K-<^',x',a') > -C(l + |x , |P + |d A (a / )n, (5.29) 

for all (t',x',a') G [0,T] x R d x M 9 , where d,A{a') is the distance from a' to A. Fix e > 
and define the function <p e G C 1 ' 2 '°([0,T] x R d x R«) by 

<p e tf,J,a') = cp(t\x\a')-$(^j^C(l + \xT + \dA(a')\*>) 
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for all {t',x',a!) G [0,T] x R d x R«, where 

A e = {fl'ei: da A (a') > e}, (5.30) 

and $ : R + -> [0, 1] is a function in C°°(M + ) such that <£|j ij = and $|[i i+0O ) = 1- Notice 
that 

(ip £ ,D x ip £ ,Dlip £ ) — > (ip,D x (p,Dltp) as e -> 0, (5.31) 

locally uniformly on [0, T] x M d x A. We notice from (|5.29p and the definition of cp E that 
(fe < v n on [0,T] xR d x A%. Moreover, since ip £ < <p on [0,T] x R d x ]R 9 , <p £ = <p on 
[0, T] x M d x A £ and a £ I, we get by (|5.28p for e small enough 

= («„ - (p £ )(t,x,a) = min (v n - (p £ ) . 

[0,T]xR d xRi 

From Step 1, we then have 



L 



(t,x,a) - £ a (p e (t,x,a) 
-f(x, a, v n (t, x, a),a J (x, a)D x tp e (t, x, a),M a p £ (t, x, a)) 
[<p e (t,x,a') - tp e (t,x,a)]X w (da') -n [<p £ (t,x,a') - (p £ (t,x,a)] + 'X w (da') > 0. 



By sending e to zero with (|5.3ip . and using a £ A with (HA 7r )(ii), we get the required 
viscosity subsolution inequality at (t, x, a) for the test function (p. □ 

5.3 The non dependence of the function v in the variable a 

In this subsection, we aim to prove that the function v(t, x, a) does not depend on a. 
From the relation defining the Markov BSDE (|5.5|) . and since for the minimal solution 
(Y t > x > a ,Z t > x > a ,U t ' x ' a ,R t ' x ' a ,K t > x > a ) to (|53]) - (j53]) . the process K l ' x ' a is predictable, we ob- 
serve that the A-jump component R l ' x ' a is expressed in terms of Y t,x ' a = v(., X t,x ' a , I t,x ' a ) 
as: 

r>t,x,ar f\ i — vt,x,a f\ i — v t,x,a T t,x,a\ , , , rr-i I ^ \ 

R s («) = v ( s , x s - ' ,a)-v(s ,X s '_ ' ' ), t<s<T,a£A, 
for all (t,x,a) € [0, T] x M. d x M. q . From the ^4-nonpositive constraint (|5.6p . this yields 

f-t+h 



E 



ft+n p 

/ / [v(s, X^ a , a') - v(s, X^\ I^ a )] + K(da')ds 
Jt J A 



0. 



for any h > 0. If we knew a priori that the function v was continuous on [0, T) x R d x A, 
we could obtain by sending h to zero in the above equality divided by h (and by dominated 
convergence theorem), and from the mean- value theorem: 

[v(t, x, a) — v(t, x, a)] + X n (da) = 0. 

Under condition (HA 7r )(i), this would prove that v(t,x,a) > v(t,x,a') for any a, a' £ A, 
and thus the function v would not depend on a in A. 
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Unfortunately, we are not able to prove directly the continuity of v from its very defi- 
nition (|5.1ip . and instead, we shall rely on viscosity solutions approach to derive the non 
dependence of v(t, x, a) in a £ A. To this end, let us introduce the following first-order 
PDE: 

- \D a v(t,x,a)\ = 0, (t, x, a) G [0, T) X R d x A. (5.32) 

Lemma 5.3 Let assumptions (HX^), (HFC), (HBC1) and (HBC2) hold. The function 
v is a viscosity supersolution to (|5.32p . - for any (t,x,a) G [0, T) xl d xi and any function 
if G C l,2 ([0,T] x (M. d x R 9 )) such that (v — <p)(t,x,a) = mm^ ^ xRdxKq (v — <£>), we have 

— \D a (p(t, x, a) | > 0, i.e. D a ip(t,x,a) = 0. 

Proof. We know that v is the pointwise limit of the nondecreasing sequence of functions 
(v n ). By continuity of v n , the function v is lsc and we have (see e.g. pQ p. 91): 

v = = liminf *v n , (5.33) 
n— >oo 

where 

liminf *v n (t,x, a) := liminf v n (t', x', a'), (t, x, a) G [0, T] x R d x W . 

n— >0O n -> oo 

(t , X , a ) — > (t, X, a) 
t' < T 

Let (t,x,a) G [0,T) xl^xi, and ^ G C^QO,? 1 ] x (M d x R«)), such that (u - ^)(t,ac,a) 
= minp T]xR <i xR'j(' i; ~~ v)- We may assume w.l.o.g. that this minimum is strict: 

(v — <p)(t, x, a) = strict min (v — (p) . (5.34) 

[0,T]xM d xR9 

Up to a suitable negative perturbation of ip for large (x,a), we can assume w.l.o.g. that 
there exists a bounded sequence (t n ,x n ,a n ) n in [0, T] x K d x R' such that 

(v n - (p)(t n ,x n ,a n ) = min (v n - tp) . (5.35) 

[0,T]xR d xR<? 

From (|5.33|) . (|5.34p . and ()5.35j) . we then have, up to a subsequence: 

(t n ,x n ,a n ,v n (tx n ,a n )) — > (t,x,a,v(t,x,a)) as n -)• oo . (5.36) 

Now, from the viscosity supersolution property of v n at (t n ,x n ,a n ) with the test function 
ip, we have by (|5.35p : 

f(%ni *^ni (^n> ^n)) < -'" T y^nj Q"n)D x (p(t n , (2 n ) , J\A ip(t n , X n , O n ) 

- / [</5(t n ,x n ,a') - <p(t n , x n ,a n )]\„(da') 
J A 

-n / [<p(t n , x n ,a) - <p(t n ,x n ,a n )] + \ n (da') > 0, 
J A 
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which implies 



A 



1 

< - 

n 



[<p(t ) - <p(tn, %n, a n )] + X n (da') 

{^ni -Em On) f-' y(^nj On) 
f\X ni (l-ai Vn (t n i X ni (In) j C T (^m ®'ri)D x ip{t n , X n , (In), ,/V( (p(t ni X n , Cl n ) ) 

[(£>(£„, a; n , a') - (/?(£„, x n , a n )]A 7r (da / ) 



Sending n to infinity, we get from (15.361) . the continuity of coefficients b,a,f3 and /, and 
the dominated convergence theorem: 

[<p(t, x, a) — ip(t, x, a)] + X 7T (da) = 0. 



A 

Under (HA„-), this means that p(t, x, a) = max n / g ^ tp(t, x, a'). Since a G A, we deduce that 
D a tp(t,x,a) = 0. □ 

We notice that the PDE (|5.32p involves only differential terms in the variable a. There- 
fore, we can freeze the terms (t,x) G [0, T) x in the PDE (|5.32j) . i.e. we can take test 
functions not depending on the variables (t, x) in the definition of the viscosity solution, as 
shown in the following Lemma. 

Lemma 5.4 Let assumptions (HX^), (HFC) ; (HBC1) and (HBC2) hold. For any 

(t, x) G [0, T) x R d , the function v(t, x, .) is a viscosity super solution to 

— \D a v(t, x, a)\ = 0, aei, 

i.e. for any a £ A and any function tp G C 2 (R. q ) such that (v(t, x, .)—</?) (a) = minjRg (v(t, x, .)- 
ip), we have: — \D a <p{a)\ > (and so = 0). 

Proof. Fix (t,x) G [0,T) x R d , a G A and ip G C 2 ^) such that 

x, .) — </?) (a) = mm(v(t,x, .) — . (5.37) 

As usual, we may assume w.l.o.g. that this minimum is strict and that <p satisfies the 
growth condition sup a / 6 ig<7 jjjfe^ < oo. Let us then define for n > 1, the function ip n G 
C^ 2 ([0,T] x (R d x R q )) by 



<p n (l/,x',a') = <p{d)-n(\t! -t\ 2 + \x' -x\ 2 p) -\a! 



a 



for all (f,x',a') G [0, T] x R d x M 9 . From the growth condition (|5.16p on the lsc function 
v, and the growth condition on the continuous function (p, one can find for any n > 1 an 
element (t n ,x n ,a n ) of [0, T] x R d x R 9 such that 

(t> - (^ n )(t n ,x n ,a n ) = min (v - <p n ). 

[0,T]xR d xR9 



2S 



In particular, we have 



v(t,x,a) - tp(a) = (v - ip n )(t,x,a) > (v - ip n ){t n , x n , a n ) 

= v(t n ,x n , On) - <p(a n ) + n(\t n - t\ 2 + \x n - x\ 2p ) + \a n 
> v(t n ,x n , a n ) - v(t, x, a n ) + v(t, x, a) - cp(a) 
+ n(\t n - t\ 2 + \x n - x\ 2p ) + \a n - a\ 2p 

by (|5.37p . which implies from the growth condition (|5.16p on v: 

n{\t n - t\ 2 + \x n - x\ 2p ) + \a n - a\ 2p < C(l + \x n - x\ p + \a n - a\ p ). 

Therefore, the sequences {n(\t n — t\ 2 + \x n — x\ 2p )} n and (\a — a n \ 2p ) n are bounded and 
(up to a subsequence) we have: (t n ,x n ,a n ) — > (t, x, a^) as n goes to infinity, for some 
Oqo G W 1 . Actually, since v(t,x,a) — tp{a) > v(t n ,x n ,a n ) — <p(a n ) by (|5.38p . we obtain by 
sending n to infinity and since the minimum in (|5.37p is strict, that = a, and so: 

(t n ,x n ,a n ) — > (t,x,a) as n — > oo . 

On the other hand, from Lemma applied to (t n ,x n ,a n ) with the test function (p n , we 
have 

= D a tp n (t n ,x n ,a n ) = D a cp(a n ) - 2p(a n - a)\a n - a| 2p_1 , 

for all n > 1. Sending n to infinity we get the required result: D a ip(a) =0. □ 
We are now able to state the main result of this subsection. 

Proposition 5.2 Let assumptions (HA), (H\), (HFC), (HBC1) and (HBC2) hold. 
The function v does not depend on the variable a on [0,T) x R d x A: 

v(t,x,a) = v(t,x,a') , a, a' £ A, 

for any (t,x) G [0,T) x R d . 

Proof. We proceed in four steps. 

Step 1. Approximation by inf- convolution. 

We introduce the family of functions (u n ) n defined by 

u n (t,x,a) = inf^ [v(t,x,a') + n\a - a'\ 2p ], (t, x, a) G [0, T] x R d x A. 

It is clear that the sequence (u n ) n is nondecreasing and upper-bounded by v. Moreover, 
since v is lsc, we have the pointwise convergence of u n to v on [0, T] x Mr x A. Indeed, fix 
some (t, x, a) G [0, T] x R d x A. Since v is lsc, there exists a sequence (a n ) n valued in A 
such that 

u n (t,x,a) = v(t,x,a n ) + n\a - a n \ 2p , 



(5.38) 
-a\ 2p 
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for all n > 1. Since A is compact, the sequence (a n ) converges, up to a subsequence, to 
some doo E A. Moreover, since u n is upper-bounded by v and v is lsc, we see that = a 
and 

u n (t,x,a) — > v(t,x,a) as n — > oo . (5.39) 

• Step 2. A test function for u n seen as a test function for v. 
For r, 5 > let us define the integer iV(r, 5) by 

iV(r,d) = mmjnEN : n > — ^ hC„| 

where C„ is the constant in the growth condition (15.16|) . and define the set As by 
As = {a E A : alia, OA) := min la — a'\ > 5} . 

Fix (i, 2) E [0, T) x M d . We now prove that for any S > 0, n > N(\x\,5), a E As and 
p E C^M 9 ) such that 

= (u n (t,x,.) - <p)(a) = mm(u n (t,x, .) - <p) , (5.40) 

there exists a n £ A and ^ E C 2 (]R' ? ) such that 

= (v(t,x, .) - ip)(a n ) = min(v(t, x, .) - ip) , (5-41) 

and 

D a ^(a n ) = D a tp{a). (5.42) 

To this end we proceed in two substeps. 

Substep 2.1. We prove that for any 5 > 0, (t,x,a) E [0, T) x ]R d x and any n > 
N(\x\,5): 

argmin {v(t, x, a) + n\a! — a\ 2p \ C A. 
a'eA 

Fix (t,x,a) E [0,T) x R d x and let a n £ A such that 

i>(£, x, a n ) + n|a n — a\ 2p = mm \v(t,x, a') + n\a' — a\ 2p ] . 

a'eA 1 J 

Then we have 

v (t, x, a n ) + n\a n — a\ 2p < v(t,x,a), 

and by (|5.16p . this gives 

-C v (l + \x\ p + 2 p ~ l max\a\ p + 2 p ~ l \a n -a\ p )+n\a n -a\ 2p < C v (l + \x\ p + \a\ p ) . 
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Then using the inequality 2afi < a 2 + (3 2 to the product 2a/3 = 2 P 1 \a n — a\ p , we get: 
(n - C v )\a n - a\ 2p < 2C V (1 + 2 2p ~ 5 + \x\ p + 2 P ~ X max \a\ p ) . 

For n > N(\x\, 5), we get from the definition of N(r, 5): 

5 

\a n -a\ < - , 

which shows that a n G A since a 6 ij. 

Substep 2.2. Fix 5 > 0, (t,x,a) G [0, T) x M d x i 5 , and <p G C 2 (M 9 ) satisfying (15^01) . 
Let us then choose a n G argmin x, a') + n|a' — a| 2p : a' G ^4}, and define tp G ^(M 9 ) 

by: 

tp(a') = ip{a + a 1 - a n ) - n\a n - a\ 2p , a' el'. 

It is clear that ip satisfies (|5.42p . Moreover, we have by (|5.40p and the inf-convolution 
definition of u n : 

ip(a') < u n (t , x , a + a' — a n ) — n\a n — a\ 2p < v(t,x,a') , a' e 1'. 

Moreover, since a n G A attains the infimum in the inf-convolution definition of u n (t,x,a), 
we have 

V>(a n ) = ip(a) — n\a n — a\ 2p = u n (t,x,a) — n\a n — a\ 2p = v(t,x,a n ) , 
which shows (|5.4ip . 

Step 3. The function u n does not depend locally on the variable a. From Step 2 and Lemma 
15.41 we obtain that for any fixed (t, x) G [0,T) x R rf , the function u n (t,x, .) inherits from 
v(t,x, .) the viscosity supersolution to 

- \D a u n (t,x,a)\ = 0, a £ As, (5.43) 

for any 5 > 0, n > N(\x\,5). Let us then show that u n (t,x,.) is locally constant in the 
sense that for all a G A$: 

u n (t,x,a) = u n (t,x,a'), Va' G B(a,r]), (5.44) 

for all rj > such that B(a,r]) C A$. We first notice from the inf-convolution definition 
that u n (t,x, .) is semi concave on As. From Theorem 2.1.7 in [6], we deduce that u n (t,x, .) 
is locally Lipschitz continuous on Ag. By Rademacher theorem, this implies that u n (t,x, .) 
is differentiable almost everywhere on As- Therefore, by Corollary 2.1 (ii) in [I], and the 
viscosity supersolution property (|5.43p . we get that this relation (|5.43p holds actually in 
the classical sense for almost all a' G A$. In other words, u n (t,x, .) has derivatives equal to 
zero almost everywhere on A$, and by Proposition IB. 1 1 in the appendix, this means that it 
is locally constant. 
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Step 4- From the convergence (|5.39p of u n to v, and the relation (|5.44|) . we get by sending 
n to infinity that for any 5 > the function v satisfies: for any (t, x, a) G [0, T) x M. d x A§ 

v(t,x,a) = v(t,x,a') 

for all rj > such that B(a,rj) C A$ and all a' G B{a,rj). Then by sending 5 to zero 
we obtain that v does not depend on the variable a locally on [0, T) x M. d x A. Since A is 
assumed to be connex, we obtain that v does not depend on the variable a on [0, T)xl rf x A. 

□ 



5.4 Viscosity properties of the minimal solution to the BSDE with A- 
nonpositive jumps 

From Proposition 15.21 we can define by misuse of notation the function v on [0, T) x R d by 

v(t,x) = v(t,x,a), (t, x) G [0, T) x M. d , (5.45) 
for any a £ A. Moreover, by the growth condition (|5.16p . we have for some p > 2: 

sup iH^i < a,. (5.46) 

(t,a:)e[0,T]xR d ^ + FT 



The aim of this section is to prove that the function v is a viscosity solution to (j5.7j) - (|5.8p . 

Proof of the viscosity supersolution property to If5.7]) . We first notice from (|5.33[) 
and (|5.45p that v is lsc and 

v(t,x) = v*(t,x) = liminf *v n (t, x, a) (5-47) 

n— >oo 

for all (t, x, a) G [0, T] x R d x i. Let (t, x) be a point in [0, T) x M d , and y? G C 1,2 ([0, T] x R d ), 
such that 

(u — ip) (t, x) = min (y — ip) . 

[0,T]xR d 

We may assume w.l.o.g. that ip satisfies sup( t ia; ) g [o i T]xiR d TO^p ^ 00 • some a £ A, and 
define for e > 0, the test function 

</(*', x', a') = ^(t'.x') -s(\t'-t\ 2 + \x'-x\ 2p + \a'-a\ 2p ), 

for all (*', x', a') G [0, TjxR^x R«. Since ip £ (t, x, a) = (p(t, x), and ip £ < ip with equality iff 
(t',x',a ! ) = (t,x,a), we then have 

(v — (p £ )(t, x, a) = strict min (v — ip 6 ). (5.48) 

[0,T]xR d xR9 

From the growth conditions on the continuous functions v n and ip, there exists a bounded 
sequence (t n ,x n ,a n ) n (we omit the dependence in e) in [0,T] x R d x R' such that 

(y n - <p e )(t n ,x n ,a n ) = min (v n - ip e ) . (5.49) 

[0,T]xR d xR9 
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From (|5.47p and (|5.48p . we obtain by standard arguments that up to a subsequence: 

(t n , x n , a n , v n (t n , x n , On)) — > (t, x, a, v(t, x)), as n goes to infinity. 

Now from the viscosity supersolution property of v n at (t n ,x n ,a n ) with the test function 
Lp £ , we have 

dip 6 a 
Q^{t n ,x n ,a n ) C n ip (t n ,x n ,o, n ) 

f{%m Q"n i Vn(tn j X n , (J n ) , <7 T {x n , (In) DxP (^m ^n.j ^n.)i ^ V ypni -^ni On) 



[^ £ (£„, x„, a') - ^ £ (^n, s n , a n )]A 7r (da / ) 

i 

n / [v? £ (t n ,a; n ,a') - ^ e (t n , x n , a„)] + A 7r (da') > 0. 



Sending n to infinity in the above inequality, we get from the definition of pf and the 
dominated convergence Theorem: 

-^-(t,x,a)-C a ip e (t,x,a) 
—f(x, a, v(t, x), cr T (x, a)D x <p £ (t, x, a),M a (f e (t, x, a)) (5.50) 



+e / \a! -a\ 2p K{da!) > 

J A 



Sending e to zero, and since ip £ (t,x,a) = ip(t,x), we get 

-^(t,x) - C a ip(t,x) - f(x,a,v(t,x),a'(x,a)D x ip(t,x),M a p(t,x)) > 0. 

Since a is arbitrarily chosen in A, we get from (HA) and the continuity of the coefficients 
b, a, 7 and / in the variable a 



~(t,x) - sup C a ip(t,x) + / (x, a, v(t, x) , o- T (x, a)D x tp(t, x), M a ip(t, x)) 



> o, 



a<=A 

which is the viscosity supersolution property. □ 

Proof of the viscosity subsolution property to (|5.7p . Since v is the pointwise limit 
of the nondecreasing sequence of continuous functions (v n ), and recalling (|5.45p . we have 
by [1] p. 91: 

v*(t,x) = limsup *v n (t, x, a) (5.51) 
n— too 

for all (t, x, a) G [0, T] x R d x i, where 

limsup *v n (t, x, a) := limsup v n (t ,x ,a). 

(t , x , a ) — > (t, x, a) 
t' < T, a' e A 

Fix (t,x) G [0,T) x R d and ip <E C x ' 2 ([0,r] x M d ) such that 

(u*-p)(t,x) = max (v*- p). (5.52) 

[0,T]xK d 
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We may assume w.l.o.g. that this maximum is strict and that p satisfies 

sup j— j— < oo . (5.53) 

Fix a € A and consider a sequence (t n , x n , a n ) n in [0, T) x l rf x i such that 

(t n ,x n ,a n ,v n (t n ,x n ,a n )) — > (t,x,a,v*(t,x)) as n ->■ oo. (5.54) 
Let us define for n > 1 the function <^ n G C 1 ' 2 '°([0,T] x M d x ]R g ) by 

tp n (l!,a/,a') = <p(t', x') + nf dA "" (a/) A 1 + \t' - t n \ 2 + \x' - x n M 

^ Vn ' 

where A Vn is defined by (|5.30j) for e = r] n and (r] n ) n is a positive sequence converging to 
s.t. (such sequence exists by (HA 7r )(ii)): 

n 2 X n (A\ A Vn ) — ► as n —t oo . (5.55) 

From the growth conditions (|5.46p and (|5.53p on v and (p, we can find a sequence (t n , x n ,a n ) 
in [0, T] x R d x A such that 

(w n - <Pn)(i n ,x n ,a n ) = max (wn-^n), n>l. (5.56) 

[0,T]x» d xA 

Using ()5.5ip and (|5.52p . we obtain by standard arguments that up to a subsequence 

n(— d A „ n (fl n ) + \t n ~ t n \ p + \x n - x n \ 2p \ — > as n y oo , (5.57) 

and 

x) as 7i ^ oo . 

We deduce from (|5.57p and ()5.54j) that, up to a subsequence: 

(t n ,x n ,a n ) — > (t,x,a), as n — > oo . (5.58) 

for some a £ A. Moreover, for n large enough, we have a n £ A. Indeed, suppose that, up to 
a subsequence, a n € dA for n > 1. Then we have — («n) > 1) which contradicts (|5.57p . 
Now, from the viscosity subsolution property of v n at (t n , x n , a n ) with the test function ip n 
satisfying (|5.56p . Lemma |5T2| and since a n G A, we have: 

(^m %m Q-n) ^ Pnitn i 

ni V n (t n , X n , O n ) , (7 T (x n , a n )D x ip(t n , x n ),M an ip(t n , x n , a n )) (5.59) 

fa') 



.(n + l)n! ( dA ^ a) AlW(daO < 

Ja K Vn > 



for all n > 1. From ()5.55j) we get 



(n + l)n [ ( Avn ^ a > Al)\Jda') — ► as n ^ oo (5.60) 

Ja K Vn > 
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Sending n to infinity into (|5.59j) . and using (|5.5ip . (|5.58j) and (|5.60p . we get 

-^(t,x)-£ a <p{t,x)- f(x,a,v*(t,x),a T (x,a)D x ip(t,x),M a ^(t,x)) < 0. 



— (t,x) - sup £ a ip(t,x) + f(x,a,v*(t, x),a T (x,a)D x ip(t,x),M a (p(t,x)) 



< 0, 



Since a £ A, this gives 
dtp 

0,X) - 

which is the viscosity subsolution property. □ 

Proof of the viscosity supersolution property to (|5.8|) . Let (x,a) G M d x A. From 
(|5.47|) . we can find a sequence (t nj x n , ci n ) n valued in [0,T") x Wl d x such that 

{tni x n , a n , v n (t n , x n , a n )) > (T, x, a, v* (T, xj) as n — > oo . 

The sequence of continuous functions (v n ) n being nondecreasing and v n (T, .) = g we have 

v*(T, x) > lim vx(t n ,x n ,a n ) = g(x,a) . 

n— >oo 

Since a is arbitrarily chosen in A, we deduce that v*(T, x) > sup ag ^ g(x, a) = sup aeA g(x, a) 
by (HA) and continuity of g in a. □ 

Proof of the viscosity subsolution property to ()5.8|) . Let x G M. d . Then we can find 
by (|5.5ip a sequence {t n ,x n ,a n ) n in [0, T) x l d x i such thats 

(t n ,x n ,v n (t n ,x n ,a n )) -> (T,x,v*(T, x)) , as n ->■ oo . (5.61) 

Define the function h : [0, T] x R d -)■ R by 

h(t,x) = VT — t + supg(a;, a) 

for all (t.a;) G [0, T) x M d . From (HFC), (HBC1) and (HBC2'), we see that /i is 
a continuous viscosity supersolution to (|5.17p - (|5.18p . on [T — rj,T] x B{x,rj) for 77 small 
enough. We can then apply Theorem 3.5 in [2] which gives that 

v n < h on [T - rj, T] x B(x, rj) x A 

for all n > 0. By applying the above inequality at (£„, x n , a n ), and sending n together with 
(I5.6ip . we get the required result. □ 



6 Conclusion 

We introduced a class of BSDEs with partially nonpositive jumps and showed how the 
minimal solution is related to a fully nonlinear IPDE of HJB type, when considering a 
Markovian framework with forward regime switching jump-diffusion process. Such BSDE 
representation can be extended to cover also the case of Hamilton-Jacobi-Bellman-Isaacs 
equation arising in stochastic differential games, and is under current investigation. From 
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a numerical application perspective, our BSDE representation suggests the following pro- 
babilistic numerical methods for the resolution of HJB equations. A direct approach would 
be to design a discretization scheme for the BSDE with constrained jumps in the line of 
numerical schemes for discretized reflected BSDEs (see [13], [1]), and this has to be deve- 
loped. Another approach would rely on time discretization and simulation of the penalized 
BSDE, but may have the drawback of slow rate of convergence due to the penalization 
coefficient in front of the generator function. An alternative and promising approach, left 
for future research, would be to apply a forward Monte-Carlo scheme on the penalized 
semi-linear PDE by means of marked branching regime switching diffusion and interacting 
particle methods, as recently proposed in [11] , 



A Appendices 

A. Comparison theorem for supersolutions to BSDEs with jumps 

We provide in this section a comparison theorem for supersolutions to BSDEs driven by 
the Brownian motion W and the compensated Poisson random measure fi. This slightly 
extends the comparison Theorem 2.5 in |22| . from which we borrow the main arguments. 

We consider two quadruples (Y\ Z l , U\ K { ) £ S 2 x L 2 (W) x L 2 (/I) x A 2 , i = 1,2, 
satisfying 

Y l t = C+ [ T F\s,Y:,Zl,Ul)ds- [ T ZldW s - [ T [ Ul(e)fi(ds,de)+K l T -K$ 

Jt Jt Jt JE 

for all t £ [0, T] and i = 1,2. Here is an J^-measurable random variable, F % : f2 x [0, T] x 
RxR d xL 2 (A)-flisaP® B(M) ® B(M. d ) ® £(L 2 (A))-measurable map. 

Theorem A.l Suppose that the coefficients (£ l ,F l ), i = 1,2, satisfy (HO). Suppose also 
that 

e > e 

F\t,Y t \Zl,Ul) > F\t,Y t \ZlU}) 
dK\ > dK} 

d¥ <%> dt-a.e. on [0,T] x fi. Then we have 

Yt 1 > if, < t < T, a.s. 

Proof. Let us denote by Y := Y x -Y 2 , Z := Z 1 -Z 2 , U := U l -U 2 , F := F l (.,Y l , Z 1 , U 1 )- 
F 2 (.,Y 2 , Z 2 , U 2 ), K := K 1 - K 2 and f = f 1 - ^ 2 so that 

Y t = f+ / F s ds- f Z s dW s - f f U 8 (i)ji(ds,di) + K T -Kt (A.l) 
Jt Jt Jt Je 

for all t £ [0,T]. Let us now define the process a by 

„ . F\t,Y t \ZlU})-F\t,Y 2 ,ZlUp 
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and b the Revalued process denned component by component by 

lk FUt,Y t 2 ,z( k - 1 \m)-F 1 (t,Y t 2 ,z( k \m) , r , 

b k t := V * * L_L^_ k ' «' * ' V t Vo}' * = l,---,d, ie[0,T], 

where Z% is the Revalued random vector whose k first components are those of Z 2 and 
whose (d — k) lasts are those of Z 1 , and V t k is the fc-th component of z[ k ^ — z[ k \ 

Notice that the processes a and b are bounded since F 2 satisfies (HO)(ii). Observe also 
that the process K defined on [0, T] by 

Kt ■= Kt~ f f 7(s,e,Y s 1 -^ 1 s ,U},U 2 )U s (e)X(de)ds 

JO JE 

+ / (F\s,Y 2 ,Z 2 ,U})-F 2 (s,Y 2 ,Z 2 ,U 2 ))ds 
J o 

is a non-decreasing process since F 2 satisfies (H0)(iii) and dK t > and Y^, Z}, U}) 
> F 2 {t,Y^,Zl,Ut), for all t G [0,T]. With these notations, we rewrite (TOjl as: 

?t = £ + + + ^ 7(s, e, Yg 1 - , Z, 1 , C/, 1 , C/ s 2 )£/ s (e)A(cfe)) ds 

- / - / / U s (e)fi(ds, de) +k T -K t . 

Jt Jt JE 

Consider now the process T defined by: 

dT t = iy (a t dt + b t dW t + J^(t,e,Y£,Zi,U},Uf)fi{dt,de)j, T = 1. 

Notice that F lies in S 2 and is positive since a, b are bounded and 7 satisfies (HO) (hi). A 
direct application of Ito's formula leads to 



t j 



d(T t Y t ) = T t -\(Z t + Y t -b t )dWt+ I rtt,e,Y£,Zl,U},U?)U t (e)ji(d8,de)]-T t -dk, 

1 JE J 

Hence, the process TY is a supermartingale, and we have 

T t Y t > E[r T Y T \F t ] = E[r T £\F t ] > 0, te[0,T], 
which proves that Y > 0. □ 

B. An additional result in analysis 

Proposition B.l Let O be an open nonempty subset of M q and u : O — > M. a locally 
Lipschitz continuous function such that 

D x u = 

almost everywhere on O. Then u is locally constant on O. 



37 



Proof. Let x <E O and r > such that B(x ,r) := {x £ R q : \x - x \ < r} C O. We 
define the function u by 

u(x) = u(U S(xor) (x)) 

for all x G M 9 , where ile^^ denotes the projection operator on the closure B(xo,r) of 
B(xQ,r). We then notice that u is globally Lipschitz continuous on M q and that it satisfies: 
D x u = 0, almost everywhere on B(xo,r). Let $ G C 00 ^ 9 ) with compact support and such 
that 

$ > and / $(x)dx = 1 . 
Define the sequence of functions (v,k)k by 

u k {x) = k q u(x - y)$(ky)dy 



Since u is Lipschitz continuous, we see that (uk)k converges uniformly to u. Moreover, for 
k > su p{I j I ■^(^)>o} ^ we nave f r0 m the dominated convergence Theorem 



D x u k {x) = D x (k q [ u(x - y)$(ky)dy) 

= k q I D x u{x - y)<5>{ky)dy = 0, 



?(0,§) 

for all x £ B(xq, |). Therefore is constant on B(xq, |) for k large enough and u and u 
are constant on B(xq, |). □ 
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